Papers with data synthesis method
Improving Grammatical Error Correction with Machine Translation Pairs (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to generate error-corrected sentence pairs for improving grammatical error correction are not available. |
| Approach: | They propose a method to generate error-corrected sentence pairs for improving grammatical error correction based on machine translation models of different qualities . |
| Outcome: | The proposed method can generate multiple error-corrected sentence pairs from Chinese to English text. |
ReasonEmbed: Enhanced Text Embeddings for Reasoning-Intensive Document Retrieval (2026.acl-long)
Copied to clipboard
| Challenge: | Recent studies suggest that traditional retrievers struggle with reasoningintensive tasks such as personal assistants and scientific research. |
| Approach: | They propose a new data synthesis method that overcomes the triviality problem prevalent in previous synthetic datasets and propose 'ReMixer', a data fusion method that generates 82K high-quality training samples. |
| Outcome: | The proposed model outperforms existing models on reasoning-intensive retrieval tasks. |
InfoSurgeon: Cross-Media Fine-grained Information Consistency Checking for Fake News Detection (2021.acl-long)
Copied to clipboard
Yi Fung, Christopher Thomas, Revanth Gangi Reddy, Sandeep Polisetty, Heng Ji, Shih-Fu Chang, Kathleen McKeown, Mohit Bansal, Avi Sil
| Challenge: | a novel approach to detect fake news is needed due to training data scarcity . current methods focus on document-level fake news detection using lexical features and semantic embeddings . |
| Approach: | They propose a novel benchmark for fake news detection at the knowledge element level . they propose synthesis method which manipulates knowledge elements to generate noisy training data . |
| Outcome: | The proposed method outperforms the state-of-the-art in detecting misinformation . it yields fine-grained explanations and outperformed the current methods . |
From General Reward to Targeted Reward: Improving Open-ended Long-context Generation Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current research on long-form context in Large Language Models (LLMs) focuses on understanding of long-contexts, but the open-ended Long Text Generation (Open-LTG) remains underexplored. |
| Approach: | They propose a method that uses data synthesis and a reward signal to enhance model performance. |
| Outcome: | The proposed method outperforms GPT-4-Turbo and improves performance by 20% on the Open-LTG task. |
Tag-Evol: Achieving Efficient Instruction Evolving via Tag Injection (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods rely on a fixed set of strategies to evolve, which requires manual design and is monolithic in form. |
| Approach: | They propose a method that uses diverse and specific knowledge tags to achieve controlled evolution by injecting different combinations of tags into original instructions. |
| Outcome: | The proposed method generates better evolved data than existing methods and is more diverse and challenging. |
Book2Dial: Generating Teacher Student Interactions from Textbooks for Cost-Effective Development of Educational Chatbots (2024.findings-acl)
Copied to clipboard
| Challenge: | Educational chatbots are a promising tool for assisting student learning, but high-quality data is difficult to obtain due to privacy concerns. |
| Approach: | They propose a framework for generating synthetic teacher-student interactions grounded in a set of textbooks and propose to open-source their results. |
| Outcome: | The proposed framework captures a key aspect of learning interactions where curious students with partial knowledge ask teachers questions about the material in the textbook. |
Unleashing LLM Reasoning Capability via Scalable Question Synthesis from Scratch (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve the mathematical reasoning capabilities of Large Language Models (LLMs) are limited due to the proprietary nature of the data. |
| Approach: | They propose a data synthesis method that generates large-scale mathematical reasoning datasets using lightweight 7B-scale models. |
| Outcome: | The proposed method outperforms existing open-source datasets in both in-domain and out-of-domain evaluations and shows improvements in code reasoning tasks. |
Improve LLM-as-a-Judge Ability as a General Ability (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies focus on generative judges, but only on their judge ability. |
| Approach: | They propose a method that leverages the generative and reasoning capabilities of large language models to evaluate LLM responses across diverse scenarios, providing accurate preference signals. |
| Outcome: | The proposed model performs on RewardBench with only 2% to 40% of the data required by other training frameworks. |
MegaPairs: Massive Data Synthesis for Universal Multimodal Retrieval (2025.acl-long)
Copied to clipboard
Junjie Zhou, Yongping Xiong, Zheng Liu, Ze Liu, Shitao Xiao, Yueze Wang, Bo Zhao, Chen Jason Zhang, Defu Lian
| Challenge: | despite the growing demand for multimodal retrieval, there is a lack of training data. |
| Approach: | They propose a data synthesis method that leverages vision language models and open-domain images to generate high-quality data. |
| Outcome: | The proposed method outperforms baseline models on 70 more datasets and can scale up. |
LogicPro: Improving Complex Logical Reasoning via Program-Guided Learning (2025.acl-long)
Copied to clipboard
Jin Jiang, Yuchen Yan, Yang Liu, Jianing Wang, Shuai Peng, Xunliang Cai, Yixin Cao, Mengdi Zhang, Liangcai Gao
| Challenge: | LogicPro is a data synthesis method that uses LeetCode-style algorithm problems and their corresponding Program solutions to generate complex logic data. |
| Approach: | They propose a new method which leverages LeetCode-style algorithm Problems and their corresponding Program solutions to synthesize complex logic data in text format. |
| Outcome: | The proposed method outperforms existing models for BBH27, LogicBench, DROP, AR-LSAT, and GSM8K, and a wide range of reasoning datasets. |